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Abstract 

Background: This project occurred during the course of the Translating Research in Elder Care (TREC) program of 
research. TREC is a multilevel and longitudinal research program being conducted in the three Canadian Prairie 
Provinces of Alberta, Saskatchewan, and Manitoba. The main purpose of TREC is to increase understanding about 
the role of organizational context in influencing knowledge use in residential long-term care settings. The purpose 
of this study was to evaluate healthcare aides' (HCAs) perceptions of a one-page poster designed to feed back 
aggregated data (including demographic information and perceptions about influences on best practice) from the 
TREC survey they had recently completed. 

Methods: A convenience sample of 7 of the 15 nursing homes participating in the TREC research program in 
Alberta were invited to participate. Specific facility-level summary data were provided to each facility in the form of 
a one-page poster report. Two weeks following delivery of the report, a convenience sample of HCAs was surveyed 
using one-to-one structured interviews. 

Results: One hundred twenty-three HCAs responded to the evaluation survey. Overall, HCAs' opinions about 
presentation of the feedback report and the understandability, usability, and usefulness of the content were 
positive. For each report, analysis of data and production and inspection of the report took up to one hour. 
Information sessions to introduce and explain the reports averaged 18 minutes. Two feedback reports (minimum) 
were supplied to each facility at a cost of CAN$2.39 per report, for printing and laminating. 

Conclusions: This study highlights not only the feasibility of producing understandable, usable, and useful 
feedback reports of survey data but also the value and importance of providing feedback to survey respondents. 
More broadly, the findings suggest that modest strategies may have a positive and desirable effect in participating 
sites. 



Background 

Integration of research findings into practice is 
dependent, in part, upon researchers presenting and dis- 
seminating findings in an effective manner. Concern 
regarding communication of research findings is under- 
pinned by evidence of the extent of the research-practice 
gap [1-11]. In healthcare the gap between what is known 
(research) and what is done (practice) is, in part, due to 
poor communication of research evidence to those 
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responsible for care delivery [12]. Thus, in order to in- 
fluence practice, the feedback of such data in a meaning- 
ful and useful manner is necessary. In particular, in the 
area of survey research, feedback of the findings is rarely 
undertaken. Further, limited evidence exists about the 
value of providing feedback of survey data [13]. A recent 
study of military personnel found that feedback of data 
and revelation of problematic areas or deficits was more 
likely to result in the survey being perceived as useful 
and, in turn, influenced respondents' intentions to 
complete future surveys [14]. In a 2007 study of pro- 
cesses and formats for feedback of survey results to 
healthcare practices, researchers identified a useful and 
feasible feedback mechanism, which involved a feedback 



© 2012 Hutchinson et al.; licensee BioMed Central Ltd. This is an Open Access article distributed under the terms of the 
Creative Commons Attribution License (http://creativecommons.Org/licenses/by/2.0), which permits unrestricted use, 
distribution, and reproduction in any medium, provided the original work is properly cited. 



Hutchinson et al. Implementation Science 2012, 7:89 
http://www.implementationscience.eom/content/7/1/89 



Page 2 of 9 



session comprising visual presentation of aggregated 
data in the form of dot plots [15]. 

From the knowledge-translation literature, evidence 
on the effectiveness of audit and feedback suggests that 
feedback of audit data has the potential to be effective in 
improving the practice of healthcare providers [16]. 
Healthcare aides (HCAs) are a unique group of health- 
care providers. In the Canadian prairie provinces, they 
are unregulated workers who are either trained on the 
job, are students, or are graduates of short certificate 
programs. They constitute the largest direct provider 
group for care of nursing home residents [17]. Many 
HCAs, especially in urban areas, are immigrants, speak 
English as a second language, and have been largely 
neglected in terms of research to understand how they 
use knowledge in their practice [18,19]. Further, there is 
little research examining the effectiveness of knowledge- 
translation interventions in long-term care settings 
[19,20]. 

The present report describes the development and 
evaluation of a feedback intervention for HCAs. This 
project is designed to link directly with and complement 
the Canadian Institutes of Health Research-funded 
Translating Research in Elder Care (TREC) program of 
research, a multilevel and longitudinal research program 
being conducted in 36 nursing homes across the three 
Canadian prairie provinces: Alberta (n = 15), Manitoba 
(n = 8), and Saskatchewan (n=13) [21-23]. The main 
purpose of TREC is to increase understanding about the 
role of organizational context in influencing knowledge 
use in long-term care settings. Within TREC there are 
two main inter-related projects and a series of pilot 
studies. The first of the main projects involves collection 
of quantitative data from several sources to explore and 
monitor the organizational context of nursing homes 
[22]. One of the main sources of data is an annual TREC 
survey administered to HCAs using computer-assisted 
personal interviews (CAPIs). The TREC survey is a suite 
of survey instruments that includes the Alberta Context 
Tool [24]. It is designed to assess organizational context 
and related factors believed to influence knowledge 
translation and the use of best practices. During year 
one of the TREC study, HCAs voiced a strong desire to 
receive feedback as the study progressed. In response to 
this request, the TREC research team initiated a 
feedback-reporting mechanism for HCAs in all facilities 
participating in the TREC research program. 

The purpose of this study was to evaluate healthcare 
aides' perceptions of a one-page poster designed to feed 
back aggregated data (including demographic informa- 
tion and perceptions about influences on best practices) 
from the TREC survey they had recently completed. The 
objectives of this project were to (1) evaluate the feasibil- 
ity of providing feedback reports (process and format); 



(2) assess the understandability of the feedback reports 
(i.e., whether the content could be comprehended); (3) 
assess the usability of the feedback reports — the pre- 
ferred method of data presentation (i.e., whether data 
were presented in a format that enabled its use); and (4) 
evaluate the usefulness/utility of the content of the feed- 
back reports (i.e., whether the variables selected for 
reporting were useful to inform behavior). 

Methods 

The project had two distinct phases: (1) development of 
the report and (2) evaluation of the report. 

Development of the feedback report 

The design of the feedback reports was guided by 
recommendations of a feasibility assessment undertaken 
in one long-term care facility in Alberta. That assess- 
ment was designed to determine the needs of HCAs 
with respect to the content and presentation of the feed- 
back report and involved consultation with HCAs, care 
managers, and a site administrator to identify data of 
most interest and relevance for feedback purposes. The 
feasibility assessment indicated that a poster format, pre- 
senting the results from four survey variables in a graph 
form with minimal explanatory text and at a Flesch- 
Kincaid reading level of grade 8 or less, was optimal for 
this HCA population. 

Factors taken into consideration in planning the pro- 
duction and delivery of feedback reports included pres- 
entation format (verbal, paper, or electronic), frequency, 
content (which variables to report), and supporting pro- 
cesses (e.g., information sessions). In developing the 
feedback reports, we adhered to general principles for 
presentation of data, including promotion of visual ap- 
peal (taking into consideration layout and use of white 
space, color, and illustrations) and making the content 
understandable (clear and concise presentation of infor- 
mation) and relevant to the HCAs. Guided by recom- 
mendations from the feasibility assessment, a one-page, 
legal-sized poster format was adopted for presentation 
of the results (Figure 1). The reports provided feedback 
to HCAs about select results from the year one TREC 
survey (which concluded in July 2009). Variables selected 
for inclusion in the feedback report were demographic 
characteristics, including country of origin, number of 
years worked at the facility, satisfaction with being a 
HCA (five-point Likert scale), and time to do something 
extra for the resident (five-point Likert scale). Facility- 
specific summary results were provided for each vari- 
able, along with comparative data reporting average pro- 
vincial results from the TREC survey. Data were 
presented in graph form using pie charts and bar graphs. 
When developing the reports, careful consideration was 
given to reading level to ensure the reports were 
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2008 Feedback Report 
Site ABC 



TREC 



TREC (Translating Research in Elder Care) is a five-year study that looks at the work environment 
and use of best practice in long-term care facilities. The goal is an improved workplace for staff and 

better care for residents. 

In late June and early July 2008, the TREC Team came to your facility. A total of 1493 health care 
aides completed the TREC survey. 867 respondents are from Alberta, 21 of these are from Site ABC. 
Here is a first look at some of the responses at your facility and across Alberta. 

Where are aides from and how long do they stay in the facility? 



Years worked on site 




lYear 

■ 2 Yean 

■ 3 Years 
5 Years 

■ 6 Years 

7 Years 

8 Years 



Site ABC HCA country of origin 




■ El Salvador 

■ Eritrea 
Philippines 
Sierra Leone 



The TREC Survey includes questions about the number of years aides worked at the facility and the 
country of origin. Over a third of the aides have worked at Site ABC for 3 years or longer. Half of the 
staff are from Canada followed by a third from the Philippines. 



Our job as health care aides 



Satisfied being a health care aide 



i Site ABC 
i Alberta 



0/w 



ies! 



Most aides are satisfied being a health care aide. This is true at most facilities across Alberta. 

Doing something extra 



75./. on?* 




Time to do something extra for residents 



Ait* 



■ Site ABC 

■ Alberta 



We asked "How often do you have time to do something extra for residents?" The graph above shows 
how health care aides at Site ABC responded. 



For more information please contact the TREC Research Manager 



Figure 1 Feedback poster report. Example, in black and white, of a site feedback poster report. 
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accessible to individuals of varying educational/reading 
levels. However, we found it difficult to achieve a Flesch- 
Kincaid grade reading level of 8 or less because some 
terms (for example, proper nouns such as country 
names) could not be simplified, and consequently, some 
segments of text exceeded this reading level. 

Evaluation of the feedback report 

The evaluation of the feedback reports and reporting 
process involved (1) surveying (administered using one- 
to-one structured interviews) HCAs to elicit their 
opinions about the understandability, usability, and use- 
fulness of the feedback reports and (2) collection of lo- 
gistical data (such as time required to develop the 
reports, time required to deliver the reports, and cost of 
report production). While all facilities (n = 36) participat- 
ing in the TREC research program received HCA feed- 
back reports, a convenience sample of approximately 
50% (n = 7) of the participating Alberta nursing homes 
(n=15) was invited to participate in the evaluation of 
the HCA feedback reports. 

Distribution of the report 

Once permission was granted by the facility administra- 
tor, the research assistants (who had administered the 
TREC survey approximately two weeks prior and were 
therefore well known in the facilities) arranged a suitable 
time with the unit managers in order to deliver the 
reports and provide a brief (15-minute maximum) infor- 
mation session for HCAs to explain the purpose and 
content and respond to questions about the report. Fol- 
lowing each information session, the research assistants 
completed a brief evaluation form to document the 
number of HCAs in attendance and record the questions 
posed. At some of the larger facilities, more than one in- 
formation session was required in order to access HCAs 
in each unit. In one province, an investigator also 
attended some feedback sessions. We recognized that 
delivery of feedback sessions required well-developed 
communications skills and careful preparation to ensure 
sensitive and appropriate responses to questions. To this 
end, standardized training (which involved in-person 
training delivered by the three Research Managers, with 
one training session held in each province), a training 
manual, and preparation time were provided to all re- 
search assistants. 

Data collection 

Evaluation survey data 

Approximately two weeks following delivery of the feed- 
back reports, HCAs who had previously completed a 
TREC survey in each of the participating facilities were 
invited to complete the evaluation survey. At each site 
included in the present study, 27 to 73 HCAs responded 



to the TREC survey, representing 39% to 96% of HCAs 
per site. We estimated that inclusion of 10 to 20 TREC 
survey respondents from these sites would be sufficient 
to achieve the objectives of this project. Across all 36 
sites included in the TREC research, 9 to 164 HCAs per 
site responded to the TREC survey, representing, on 
average, 52% (range: 28%-96%) of HCAs at each site. 

Our experience in TREC was that face-to-face struc- 
tured interviews were the optimum method of survey 
data collection from HCAs. We found that this approach 
maximized data validity and minimized missing data. 
Hence, research assistants conducted short (5-10 min- 
utes), one-to-one structured interviews with HCAs. The 
research assistants arranged a convenient time two 
weeks following delivery of the reports to conduct the 
structured interviews with HCAs. Written, informed 
consent was obtained prior to each interview, which was 
conducted in a quiet, private location in each facility. 
Structured questions elicited HCAs' opinions about 
understandability of information included in the feed- 
back reports; whether information was presented in a 
usable manner, that is, in a format that could inform 
practice or influence change; whether content of the re- 
port was relevant and useful to policy and practice; 
whether the report delivery process was appropriate in 
terms of timing and access to the report; and whether 
the accompanying information session was accessible 
and helpful. When a respondent identified deficits or 
weaknesses in the reports, the research assistants asked 
the HCA for suggestions or recommendations to im- 
prove the report. Examples of interview questions for 
each evaluation parameter are provided in Table 1. 

Logistical data 

Evaluation of the reporting process involved collection 
of logistical data on (i) time spent analyzing relevant 
TREC survey data and report production, (ii) time spent 
providing information sessions to introduce and explain 
the reports, (iii) the number of reports required by each 
facility, (iv) the most appropriate report topics, and (v) 
the cost of printing reports. Research assistants moni- 
tored the time invested for each activity and recorded 
these data in a spreadsheet on an ongoing basis as the 
study progressed. 

Ethical considerations 

Human Research Ethics Board (HREB) approval for the 
conduct of this study was received from the University 
of Alberta, and permission of individual facility adminis- 
trators was obtained to conduct the study in the respect- 
ive facilities. In accordance with Tri-Council standards 
for research [25] and the HREB guidelines at the Univer- 
sity of Alberta, informed consent was sought from 
HCAs prior to conducting the surveys. 
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Table 1 Examples of survey questions 



Feedback report evaluation parameters Example Response options 



Presentation of the report 


Thinking about the appearance of 
the report, would you describe it as: 


Very unattractive 
Somewhat unattractive 

INcI U ICl dLLldLLIVtr IIUl UlldLLIdLLIVt: 
JUIIICVVIIOl OLLId^LIVt: 
Vtriy dLLIdLLIVt: 


Understandability of the report 


Thinking about the language in the 
report, would you describe it as: 


Very difficult to understand 

Somewhat difficult to understand 
Neither difficult nor easy to understand 
Somewhat easy to understand 
Easy to understand 


Usability of the report 


Thinking about use of the 


Very unlikely 




information in the report, would you use it to 


Somewhat unlikely 




infh ipnrp the wp.v vn I nrartirp 1 

II IIILICI LI ICT VVOV VUU LJIQV^lll^C 


Mpjthpr likply nnr iinlilfpK/ 

Somewhat likely 
Very likely 


Usefulness of the report 


Thinking about the information in the report, 
how useful is this information to you in your role? 


Not at all useful 

Slightly useful 
Somewhat usefu 
Very useful 
Extremely useful 


Information session content 


Thinking about the information session, did 
you find the information that was presented: 


Very difficult to understand 

Somewhat difficult to understand 
Neither difficult nor easy to understand 
Somewhat easy to understand 
Very easy to understand 


Suggestions/recommendations 


Do you have any suggestions for 

improving the appearance of the feedback report? 


Open-ended questions 



Data analysis 

The evaluation survey data were double entered into a 
Statistical Package for Social Sciences (SPSS) version 17 
(SPSS Inc., Chicago, IL, USA) database for analysis [26]. 
Descriptive statistics and cross tabulations were used to 
analyze evaluation survey data, and summary data 
described the logistical outcomes. 

Results 

In total, 123 HCAs completed the evaluation survey 
(structured interview). On average, we surveyed 43% 
(range: 31%-70%) of the respondents to the TREC sur- 
vey at each of the sites. The majority (94.3%) of respon- 
dents were female. On average, respondents had worked 
as a HCA for 9 years, had worked in the respective facil- 
ity for 6.5 years, and 40% reported English as their 



second language (ESL) (Table 2). Demographic data for 
the TREC Alberta-only HCA sample and for the TREC 
Alberta, Manitoba, and Saskatchewan HCA sample are 
included in Table 2. These data demonstrate that the 
feedback survey respondents (n = 123) were demograph- 
ically similar to the wider group of TREC survey respon- 
dents (Alberta only n = 864; Alberta, Manitoba, and 
Saskatchewan n= 1,489). Overall, healthcare aides' opi- 
nions about the presentation of the feedback report and 
the understandability, usability, and usefulness of the 
content were positive (Table 3). 

Feedback reports 

In total, 88.6% of respondents rated the feedback report 
as attractive. In terms of understandability of the report 
content, 71.5% of respondents were satisfied with the 
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Table 2 Demographics 



Present study (n = 1 23) TREC Alberta (n = 864) TREC Alberta, Manitoba, and Saskatchewan (n = 1 ,489) 



N (%) 



Mean (SD) 



N (%) 



Mean (SD) 



N (%) 



Mean (SD) 



Gender 



Age 



Males 
Females 



<20 years 
20-29 years 
30-39 years 
40-49 years 
50-59 years 
60-70 years 
>70 years 
Years worked as HCA 
Years worked in facility 
Education level 

High school 
HCA certificate 
Diploma or degree 
English as second language 



7 (5.7) 
116 (94.3) 

3 (2.4) 
11 (9.0) 
35 (28.5) 
38 (30.9) 
28 (22.8) 
7 (5.7) 
0 (0.0) 



110 (89.4) 
98 (79.7) 
60 (48.8) 
48 (39.0) 



9.02 (6.9) 
6.58 (5.9) 



50 (5.8) 
803 (92.9) 

8 (0.9) 
97 (11.2) 
191 (22.1) 
280 (32.4) 
230 (26.6) 
57 (6.6) 
1 (1.0) 



787 (91.1) 
687 (79.5) 
450 (52.1) 
449 (52.0) 



92 
1,386 

13 
164 
312 
482 
400 
115 
1 



9.62 (8.7) 
N/A 



1,345 
1,234 
658 
660 



(6.2) 
(93.1) 

(0.9) 

(11.0) 

(21.0) 

(324) 

(26.8) 

(7.7) 

(1.0) 



(90.3) 
(82.9) 
(44.2) 
(44.3) 



10.86 (8.9) 
N/A 



TREC = Translating Research in Elder Care; SD = standard deviation; HCA = healthcare aide; N/A = not available. 



quantity of text provided, 91.1% of respondents indicated 
that the text was easy to understand, and 95.2% indi- 
cated that the graphics were easy to understand. With 
respect to the usability of the feedback, 58.6% of respon- 
dents said that they were likely to use the results to in- 
form their practice, while 49.6% of respondents 
indicated that the findings were likely to change the way 
they thought about their role. When it came to useful- 
ness of the data reported in the feedback report, 61.8% 
of respondents indicated that, in general, the informa- 
tion was very useful, with 53.7% indicating that the in- 
formation was very useful in their role as HCAs. 

Given that a large proportion of respondents reported 
having ESL, we tested for an association between lan- 
guage status and perceptions of the feedback report. 
After categorizing responses to the question about quan- 
tity of text into "too little," "satisfactory," or "too much," 
the chi-square test for independence indicated a signifi- 
cant association between language status and perception 
of the quantity of text in the report (x 2 (2, 
n = 123) = 14.97, p <.000). Specifically, fewer people with 
ESL were satisfied (approximately 50%) with the quantity 
of text in the poster when compared with the number of 
people with English as their first language who were sat- 
isfied (84%). However, a clear trend in the opinions of 
those with ESL about whether too much (as reported by 
21% of ESL respondents) or too little text (as reported 
by 27% of ESL respondents) existed was not evident. 



Significant associations were also found between ESL 
and likelihood of the results to influence practice (x (2, 
n = 123) = 23.44, p <.000), likelihood of the results to in- 
fluence thinking (x 2 (2, n = 123) = 9.12, p = .011), percep- 
tions of usefulness of the feedback in general (x 2 (2, 
n = 123) = 22.17, p <.000), and usefulness of the feedback 
in their role (x 2 (2, n = 123) = 24.70, p <.000). Specifically, 
a greater proportion of individuals with ESL indicated 
the results were likely to influence their practice and 
their thinking and reported that the information, in gen- 
eral and in their role, was useful. 

Information sessions 

Attendance at the sessions was voluntary, and the num- 
ber of individuals that attended was also subject to avail- 
ability of HCAs on the days the sessions were scheduled. 
Of the 123 survey respondents, 52 (42.3%) had attended 
one of the information sessions at which the feedback 
reports were presented. Of these individuals, 61.5% 
reported that the information presented was either very 
useful or extremely useful. With regard to understand- 
ability, 40% reported that the information was easy to 
understand, and 48% reported that it was very easy to 
understand. We also analyzed the data for differences in 
perceptions of the feedback report based on attendance 
versus nonattendance at the information sessions. No 
statistically significant differences in perceptions were 
found between the two groups. Research assistants 
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Table 3 Evaluation of feedback reports (N = 123) 





N (%) 


N (%) 


N (%) 


Presentation 








Appearance 


Unattractive 


Neutral 


Attractive 




9 (7.3) 


5 (4.1) 


109 (88.6) 


Location on unit 


Poor 


Fair 


Good 




19 (15.4) 


20 (16.3) 


84 (68.3) 


Understandability 








Quantity of text 


Too little 


Neutral 


Too much 




14 (11.4) 


88 (71.5) 


21 (17) 


Language 


Difficult 


Neutral 


Easy 




7 (5.7) 


4 (3.3) 


112 (91.1) 


Graphics 


Difficult 


Neutral 


Easy 




1 (0.8) 


5 (4.1) 


117 (95.2) 


Usability 








To change practice 


Unlikely 


Neutral 


Likely 




37 (30.1) 


14 (11.4) 


72 (58.6) 


To change thinking about role 


Unlikely 


Neutral 


Likely 




43 (35.0) 


19 (15.4) 


61 (49.6) 


Usefulness 


Not useful 


Somewhat 


Very 


Usefulness of information 


1 2 (9.8) 


35 (28.5) 


76 (61.8) 


Usefulness in role 


28 (22.8) 


29 (23.6) 


66 (53.7) 



reported that, overall, the information sessions were well 
received by the HCAs and acted as a venue for HCAs to 
raise questions. Further, it was noted that HCAs 
expressed their gratitude towards the researchers for 
making the effort to return to the facility in order to feed 
back some of the study findings. 

Findings from logistical data 

On average, up to one hour in total was spent by data 
analysts and investigators in analyzing the relevant 
TREC survey data for inclusion in the report and produ- 
cing and inspecting the report for each facility. A mini- 
mum of two feedback reports (posters) per facility were 
supplied, and one additional poster was also supplied for 
every 50 beds in excess of 100 beds. Posters were pro- 
duced in tabloid size (27.9 by 43.2 cm) and were lami- 
nated. The cost per poster for printing and lamination 
was CAN$2.39. In total, 7.35 hours were spent delivering 
the information sessions (n = 25) to facility staff, and the 
sessions averaged 18 minutes (range: 5-45). On average, 
four (range: 1-9) information sessions were conducted 
per facility. 

Discussion 

Feedback represents an important part of the translation 
phase of the research process and has a range of poten- 
tial benefits, including promoting the translation of 



evidence into practice and engagement of participants in 
future research. To enable feedback initiatives as part of 
the research process, the cost of providing feedback 
should be built into research budgets. In the following, 
our discussion will center on the consequences for prac- 
tice and research and the feasibility of providing feed- 
back to survey respondents. 

Consequences for practice of providing feedback to 
survey participants 

Our broad purpose was to develop a knowledge- 
translation intervention that would assist in reducing the 
research-practice gap. Feedback of relevant data and 
presenting them in a format that is easily understood 
has the potential to facilitate ownership of the results 
and promote the implementation of research-based 
changes in practice. Further, other researchers report 
that engagement of and ownership by care providers is 
an important element in motivating practice change 
based on research evidence [27-29]. While our findings 
indicate that almost 60% of respondents felt the research 
findings were likely to inform their practice, approxi- 
mately 62% reported that the findings were generally 
useful, and approximately 54% indicated that the find- 
ings were useful to them in their roles, these results 
could be a reflection of the types of variables selected 
for inclusion in the feedback report. In particular, the 
demographic data, while interesting, cannot be used to 
inform practice. The data for questions relating to satisfac- 
tion with role and the availability of time to do something 
extra for residents are more likely to stimulate discussion 
than inform the practice of HCAs. However, these data 
may have influenced managers' and facility administrators' 
approaches to resourcing and organization of care. 

We were cognizant of the fact that we had to be care- 
ful and respectful about the type of information we were 
feeding back. In the feedback report development phase 
we consulted with HCAs, research assistants who were 
working closely with HCAs during the TREC study data 
collection, and facility managers. We asked them to con- 
sider and advise on which variables would be appropri- 
ate, of interest, and relevant to HCAs. Variable selection 
was therefore guided by their recommendations as well 
as our judgment regarding the potential sensitivity of the 
data. For example, we were careful to avoid reporting on 
variables such as leadership and staffing levels, which 
could have reflected negatively on a facility or could 
have been inflammatory or have caused controversy. 

Consequences for future research of providing feedback 
to survey respondents 

HCAs expressed gratitude for the investigators' efforts 
to provide feedback on the survey results. This under- 
taking was perceived as evidence that the investigators 
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considered the HCAs important to the TREC research. 
This finding resonates with literature that has identified 
survey respondents' dissatisfaction with not receiving 
feedback about study results, which, in turn, can prompt 
a sense of exploitation by researchers and potentially 
can lead to apathy about or disinterest in participating in 
research in the future [30,31]. Other research, consistent 
with the findings of our study, identified the importance 
of researchers feeding back the study findings in-person 
[13]. 

The feedback of research findings has implications for 
the wider research domain. The provision of feedback 
acknowledges respondents' contribution to the research 
and, in the course of a study that has two or more data 
collection points, can be an important strategy to pro- 
mote goodwill, future participant engagement, and trust. 
However, consideration needs to be given to the effects 
that such an activity may have on future data. Feedback 
may alter behavior and may, therefore, influence study 
findings, potentially confounding them. The purpose of 
the study will likely determine whether it is appropriate 
to feed back findings during the conduct of the research. 
In the case of the TREC program of research, an inte- 
grated approach, involving the knowledge users, was 
adopted. We recognized that our feedback could influ- 
ence healthcare aides' behavior, thereby influencing fu- 
ture results. However, we weighed this against the 
specific requests from HCAs for feedback and consid- 
ered that failure to provide feedback could be detrimen- 
tal to our research relationship and credibility and that 
this may negatively affect healthcare aides' willingness to 
participate in future surveys in the TREC program of re- 
search. In the process of delivering feedback, careful 
consideration should also be given to the potential 
effects of feedback that might be perceived in a negative 
light. Such feedback should be delivered sensitively, and 
researchers should be cognizant that negative feedback 
may adversely affect future response rates. 

Feasibility of providing feedback to survey participants 

We aimed to develop a cost-effective feedback mechan- 
ism that conveyed relevant data in a clear, useful, and 
usable format. The poster approach, which provided 
data in a visual display with the minimum amount of ex- 
planatory text required to describe the results, was well 
received. We found that once the initial feedback report 
poster template had been developed, the poster could be 
produced with ease, was inexpensive, and was a useful 
means of presenting information in an accessible man- 
ner. In all, investment of time and money to produce the 
posters and provide the information sessions was out- 
weighed by the benefits of satisfying survey respondents 
through the delivery of feedback and enhancing the 
chances that they would respond to future surveys. A 



range of approaches could be adopted for the delivery of 
feedback. In deciding which approach to adopt, 
researchers should carefully consider the target audience 
and the context in which the findings are being delivered 
and then tailor their approach accordingly. The signifi- 
cant associations that we found between ESL and char- 
acteristics of the feedback point to the importance of 
considering the needs of audiences for whom English is 
not their first language when delivering feedback. Add- 
itionally, researchers should consider and monitor the 
resource requirements associated with delivery of the 
feedback [32]. 

Limitations 

There are some limitations associated with this study. In 
particular, the study was set in a small number of long- 
term care facilities in a single Canadian province. There- 
fore, while we achieved the number of responses for 
which we had aimed at the outset of the study, our data 
represent a limited number of HCAs working within a 
distinct setting. Given these constraints, we recommend 
caution when generalizing the study findings to other 
settings. 

Conclusion 

This project was designed to explore feedback reporting 
for the communication of survey data to HCAs. The de- 
livery of feedback in a poster format presenting informa- 
tion graphically and with the minimum amount of text 
required to explain the results was positively received in 
the HCA sample included in this study. The importance 
of providing feedback to research participants was rein- 
forced by the responses of participants at the informa- 
tion sessions, who expressed their gratitude for the 
feedback and their keen interest in how the findings of 
the TREC study would be used to influence policy and 
practice. 
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